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IMAGE ENCODING APPARATUS, 
IMAGE ENCODING METHOD AND PROGRAM 
BACKGROUND OF THE INVENTION 
Field of the Invmtion 

5 The present invention relates to an image encoding apparatus, an image encoding 

method and a program. 

Description of the Related Art 
One of schemes for encoding an image is JPEG (Joint Photographic Experts Group) 
based on the ISO/EC 10918 Recommendation prepared by the ISO (International 
1 0 Organization for Standardization) and lEC (International Electrotechnical Commission). 
JPEG can acquire a relatively high compressibility. JPEG however suffers 
significant degradation of image quality at a low bit rate, 

JPEG2000 based on the ISO/IEC 15444 Recommendation is one scheme which 
ensure suppressed degradation of image quality even at a low bit rate. 
15 At the same compressibihty. tiie quality ot an image compressed by JPEG2000 is 

higher than the quality of an image compressed by JPEG With the same image quality, the 
compressibility of JEBG2000 is higher than the compressibility JPEG Further, JPEG2000 
can execute an encoding process through nearly the same procedures in both lossless 
encoding and lossy encoding. 
20 In view of ttie aforementioned advantages, JPEG2000 is expected to become 

popular as an mcoding system (compression system) for compressing image signals 
generated by a digital camera, an image scanner and so forth and an oicoding system 
(compression system) for compressing image data to be distributed over die Internet 

But, a higher compressibility is needed to send high-quality image data at a high 
2 5 speed in narrow-band conmiunication, such as wireless communication. 

The contents of the ISO/IEC 15444 Recommendation are incorporated herein by 
reference. 
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SUMMARY OF THE INVENTION 
Accordingly, it is an object of the invention to provide an image encoding apparatus, 
an image encoding method and a program for compresMng images at a high compressibility. 
To achieve the object, an image encoding £^paratus according to the first aspect of 
5 the invention encodes an image signal according to a JPEG2000 standard, and comprises: 
a wavelet converter which acquires a plurality of conversion coefficients by 
performing wavelet conversion on the image signal; 

a modeling unit which generates a plurality of symbols representing the plurality of 
conversion coefficients and a plurality of contexts by performing a modeling process on the 
1 0 plurality of conversion coef&cimts obtained by the wavelet converter; and 

an arithmetic encoder which performs arithmetic encoding using the plurality of 
symbols and the plurality of contexts generated by the modeling unit, 

wherein tibie arithmetic encoder discriminates whetibier each of the symbols is an 
MPS (More Probable Symbol) or LPS (Less Probable Symbol), executes CODEMPS in a 
1 5 case where it is discriminated that the symbol is an MPS and executes either CODEMPS or 
CODELPS according to a predetermined condition in a case where it is discriminated that 
the symbol is an LPS. 

This invention can compress images at a high compressibility. 
In a case where it is discriminated that the symbol is an LPS, the arithmetic encoder 
2 0 may compare a probability of occurrence of an LPS corresponding to a current context with 
a predetermined threshold value, execute the CODEMPS in a case where the probability of 
occurrence is greater than the threshold value and execute tiie CODELPS in a case where 
the probability of occurrence is not greater than the threshold value. 

hi a case where the probability of occurrence is greater than the threshold value, the 
2 5 arithmetic encoder may change a value of the symbol and executes the CODEMPS. 

The modeling unit may classify the plurality of conversion coeflFicients to a 
plurality of bit planes and classify the plurality of conversion coefGcients to a plurality of 



encoding passes to thereby generate the plurality of symbols, 

the threshold value may be independently set for each of the plurality of encoding 
passes, and 

die arithmetic encoder may use different threshold values for the plurali^ of 
encoding passes respectively 

The wavelet converter may divide an image represented by the image signal into a 
plurality of sub bands, 

the threshold value may be independently set foi each of the plurality of sub bands, 

and 

the arithmetic encoder may use differrat threshold values for the plurality of sub 
bands respectively 

That threshold value which is associated with a sub band LL in the plurality of sub 
bands may be set larger than those threshold values which are associated with the other sub 
bands and that threshold value which is associated with a sub band HH may be set smaller 
than those threshold values which are associated with the other sub bands. 

The threshold value associated with the sub band LL may be set larger than a value 
the probability of occurrence can take. 

In a case where it is discriminated that the symbol is an LPS, the arithmetic encoder 
may discriminate whether or not an encoding pass to be processed is a degrading pass to 
degrade an image quality as a result of execution of the CODEMPS in a case where Ae 
symbol is an LPS, execute the CODELPS in a case where it is discriminated tfiat the 
encoding pass is the degrading pass, and compare the probability of occurrence with the 
threshold value in a case where it is discriminated that the encoding pass is not the 
degrading pass. 

An image encoding method according to the second aspect of the invention encodes 
an image signal according to a JPEG2000 standard and comprises: 

acquiring a plurality of conversion coefficients by performing wavelet conversion 



on the image signal; 

generating a plurality of symbols representing the plurality of conversion 
coefficients and a plurality of contexts by p^orming a modeling process on the plurality of 
conversion coefBcients obtained by the wavelet conversion; and 

perfonning arithmetic encoding using the plurality of symbols and the plundity of 
contexts generated by the modeling process, 

wherdn the pfenning arithmetic encoding includes discriminating whether each 
of the symbols is an MPS (More Probable Symbol) or LPS (Less Probable Symbol), 
executing CODHMPS in a case where it is discriminated that the symbol is an MPS and 
executing either CODEMPS or CODEIPS according to a predetermined condition in a 
case where it is discriminated that the symbol is an LPS. 

The executing either CODEMPS or CODELPS may include: 

comparing a probability of occurrrace of an LPS conesponding to a current context 
with a predetermined threshold value; 

executing the CODEMPS in a case where the probability of occurrence is greater 
than die threshold value; and 

executing die CODELPS in a case where the probabiliQ^ of occurrence is not 
greater than the threshold value. 

The executing either CODEMPS or CODELPS fiuther may include changing a 
value of the symbol in a case whore the probabiUty of occurrence is greater than the 
threshold value. 

The generating the plurality of symbols and the plurality of contexts may include 
classifying the plurality of conversion coefficients to a plurality of bit planes and classifying 
the plurality of conversion coefficients to a plurality of encoding passes to thereby generate 
the plurality of symbols, 

the threshold value may be independently set for each of the plurality of encoding 
passes, and 
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the performing arithmetic encoding may include using different threshold values for 
the plurality of encoding passes respectively. 

The acquiring the plurality of conversion coefficients may include dividing an 
image represented by die image signal into a plurality of sub bands by wavelet conversion, 
5 the threshold value may be independently set for each of the plurality of sub bands, 

and 

the performing arithmetic encoding may include using different threshold values for 
the plurality of sub bands respectively. 

That threshold value which is associated with a sub band LL in the plurality of sub 
1 0 bands may be set larger than fliosc threshold values which are associated with the other sub 
bands and that threshold value which is associated with a sub band HH may be set smaller 
than those threshold values which are associated with the other sub bands. 

The threshold value associated with the sub band LL may be set larger than a value 
the probability of occurrence can take. 
1 5 The performing arithmetic encoding may further include discriminating whether or 

not an encoding pass to be processed is a degrading pass to degrade an image quality as a 
result of execution of the CODEMPS in a case where the symbol is an LPS, in a case where 
it is discriminated that the symbol is an LPS, and executing the CODELPS in a case where 
it is discriminated that the encoding pass is the degrading pass, and 
20 the comparing the probability of occuirrace with the threshold value may include 

comparing the probability of occurrence with the threshold value in a case wh^e it is 
discriminated that the ^coding pass to be processed is not the degrading pass. 

A program according to the third aspect of the invention allows a computer to 
function as an image encoding apparatus for encoding an image signal according to a 
2 5 JPEG2000 standard, which comprises: 

a wavelet converter which acquires a plurahty of conversion coefficients by 
performing wavelet conversion on the image signal; 



a modeling unit which generates a plurality of symbols representing the plurality of 
conversion coeflBcients and a plurality of contexts by performing a modeling process on the 
plurality of conversion coefficients obtained by the wavdct converter, and 

an arithmetic encoder which performs arithmetic ^coding using die plurality of 
symbols and the plurality of contexts generated by the modeling unit, 

wherein the arithmetic encoder discriminates whether each of the symbols is an 
MPS (More Probable Symbol) or LPS (Less Probable Symbol), executes CODEMPS in a 
case where it is discriminated that flie symbol is an MPS and executes either CODEMPS or 
CODELPS according to a predetermined condition in a case where it is discriminated that 
the symbol is an LPS. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The object and other objects and advantages of the present invention will become 
more apparent upon reading of the following detailed description and the accompanying 
drawings in which: 

Fig. 1 is a structural diagram of an encoding/decoding apparatus according to one 
embodiment of the invention; 

Fig. 2 is a diagram showing the structure of a JPEG2000 encoding section which 
constitutes the encoding/decoding apparatus in Fig. 1; 

Fig. 3 is a diagram showing an exan^)le of wavelet conversion which is executed 
by a wavelet conversion section that constitutes ttie JPEG2000 encoding section in Fig. 2; 

Fig. 4 is a diagram showing a modeling process which is executed by a coefficient 
modeling section that constitutes tiie JPEG2000 encoding section in Fig. 2; 

Fig. 5 A is a flowchart illustrating an arithmetic ^coding process which is executed 
by an arithmetic encoding section that constitutes the JPEG2000 encoding section in Fig. 2; 

Fig. 5B is a flowchart illustrating an encoding process that constitutes the arithmetic 
encoding process in Fig. 5A; 

Figs. 6A and 6B are flowcharts illustrating a CODEl process and CODED process 



that constitute the encoding process in Fig. 5B and are executed whai the invention is not 
adapted; 

Fig. 7 A is a flowchart illustrating a CODEl process that constitutes the encoding 
process in Fig. 5B and is executed when the invention is adapted; 

Fig. 7B is a flowchart illustrating a CODEO process that constitutes the encoding 
process in Fig. SB and is executed when die invention is adf^ted; 

Fig. 8A is a flowchart illustrating another example of the CODEl process shown in 
Fig. 7A; and 

Fig. 8B is a flowchart illustrating another example of the CODEO process shown in 

Fig. 7B. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

An image encoding/decoding apparatus according to one embodiment of the 
invention will be described below with refi^nce to the accompanying drawings. 

The following description will be given of a case where the invention is adapted to 
an image encoding/decoding apparatus which performs encoding and decoding based on 
the JPEG2000 standard. 

As shown in Fig. 1, die image encoding/decoding apparatus according to the 
embodiment of the invention comprises an image input section 1, an encoding section 2, a 
data storage section 3, a decoding section 4, an image output section 5, an code output 
section 6 and a control section 7. 

The image input section 1 is connected to an extemal input unit, such as a digital 
camera, image scanner and/or a memory unit creating image signals. The image input 
section 1 inputs image signals, supplied from the connected input unit, to the encoding 
section 2 under die control of die control section 7. 

The encoding section 2 encodes (compresses) input image signals based on the 
JPEG2000 standard under the control of die control section 7. The encoding section 2 
stores image data obtained by encoding (compression) in die data storage section 3. The 
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detailed stnicture of the Hicoding section 2 will be discussed later. 

The data storage section 3 is comprised of a sraiiconductor memory and/or a hard 
disk or the like. The data storage section 3 stores image data generated by the encoding 
section 2. 

The decoding section 4 reads predetemoined image data from the data storage 
section 3 under the control of the control secdon 7. The decoding section 4 decodes 
(expands) the read image data based on the JPEG2000 standard under the control of the 
control secdon 7. This restores the original image signals. The decoding section 4 sends 
the restored image signal to the image output section S. 

The image output section 5 is connected to an external output unit, such as a printer 
and/or display. The image output section 5 sends image signals supplied ftom the decoding 
section 4 to the connected output unit under the control of the control section 7. 

The code output section 6 is connected to a communication netwod^ such as the 
fatcmet and/or telephone circuit network. The code output section 6 reads piedetemiined 
image data from the data storage section 3 under the control of the control section 7. The 
code output section 6 transmits die read image data to a predetermined terminal located at a 
remote place via the commxmication network under die control of the control section 7. 
The code output section 6 is connected to an external decoding unit which has a decoder to 
decode image data based on the JPEG2000 standard. The code output section 6 sends the 
image data read firom the data storage section 3 to the connected decoding unit under the 
control of the control section 7. 

The control section 7 is comprised of a CPU (Central Processing Unit). The control 
section 7 controls the operations of the individual sections that constitute the image 
encoding/decodmg apparams according to a program provided beforehand. 

The detailed structure of the encoding section 2 will be discussed below. 

The structure of the encoding section 2 described below may be realized by 
hardware such as an LSI (Large Scale Integrated circuit) or may be realized by a software 



program. The structure of the encoding section 2 may also be realized by the combination 
of a software program and hardware. la case where the encoding section 2 is realized by 
the combination of a software program and hardware (e.g., a coprocessor for image 
compression or the like), the coprocessor takes charge of, for example, a wavelet 
5 conversion process, quantization process and arithmetic ^coding process which vdll be 
discussed later. 

Fig. 2 is a structural diagram of the encoding section 2. 

As shown in Fig. 2, the encoding section 2 comprises a DC level/color conversion 
section 11, a wavelet conversion section 12, a quantizing section 13, a coefficient modeling 

1 0 section 14, an arithmetic encoding section 15 and a code order control section 16. 

The DC level/color conversion section 11 performs a level shifting process, color 
space conversion and tiling process on an image signal (RGB signal representing an image 
in red, green and blue) supplied fiom the image input section 1 . 

Specifically, the DC level/color conversion section 11 shifts Ihe dynamic range of 

15 the supplied image signal by a half in the level shifting process. Through color space 
conversion, the DC level/color conv^on section 1 1 converts the supplied image signal 
(RGB signal) to an image signal which represents an image with luminance (Y) and two 
color differraces (Cb, Cr). The DC level/color conversion section 11 divides the image 
represented by the image signal into a plurdlity of areas in the tiling process. 

2 0 The DC level/color conversion section 1 1 sends the image signal, which has 

undergone the level shifting process, color space conversion and tiling process, to the 
wavelet conversion section 12. 

The wavdct conversion section 12 performs wavelet conversion on the image 
signal supplied from the DC level/color conversion section 11. As a result, the wavelet 

2 5 conversion section 12 acquires wavelet coefficients (conversion coefficimts). The wavelet 
conversion section 12 sends the convc^on coefficients, obtained through wavelet 
conversion, to the quantizing section 13. 



The quantizing section 13 quantizes the conversion coefficients supplied ficom the 
wavelet conveision section 12. In case where the color space conversion by the DC 
level/color conversion section 1 1 and the wavelet conversion by the wavelet conversion 
section 12 are reversible, the quantization by the quantizing section 13 is omitted. 

The coefficient modeling section 14 performs a modeling process on the conversion 
coefficients supplied from the quantizing section 13. Accordingly, the coefficient modeling 
section 14 generates symbols D and contexts CX to be used by the arithmetic encoding 
section 15 at the time of executing arithmetic encoding. The specific contents of the 
modeling process will be described later. 

The arithmetic encoding section 15 performs arithmetic encoding (entropy 
encoding) using the symbols D and contexts CX generated by the coefficient modeling 
section 14. The specific procedures of the arithmetic encoding will be described later. 

The code order control section 16 sorts data, acquired Ihrou^ the arithmetic 
encoding performed by the arithmetic encoding section 15, in accordance with a 
predetermined priority Gayer, spatial resolution level, block position or color component). 
Accordingly, the code order control section 1 6 generates a bitstream. Further, flie code 
order control section 16 adds header infoimation to the generated bitstream. The code 
order control section 16 stores the header-information added bitstream in the data storage 
section 3. 

The following will discuss the operation of the image encoding/decoding apparatus 
having the above-described structure. 

It is to be noted that the operations of the individual sections, discussed below, 
which constitute the image encoding/decoding apparatus will be carried out under the 
control of the control section 7. 

First, an image signal (RGB signal) representing an image is input to the image 
input section 1 from the external input unit connected to the image encoding/decoding 
apparatus. 



TTie image input section 1 inputs the image signal, supplied from the input unit, to 
the encoding section 2. 

The DC level/color conversion section 11 of the encoding section 2 performs the 
level shifting process on Ihe supplied image signal. Accordingly, the DC level/color 
conversion section 1 1 shifts the dynamic range of the supplied image signal by a half. 

Subsequently, the DC level/color conversion section 11 performs color space 
conversion on the supplied image signal. Accordingly, the DC level/color conversidn 
section 1 1 converts the supplied RGB signal to an image signal which represents an image 
with luminance ( Y) and color differraces (Cb, Cr). 

Further, ttie DC level/color conversion section 11 performs the tiling process on the 
image signal that has undeigone the level shifting process and color space conversion. 
Accordingly, the DC level/color conversion section 11 divides the image lepiesented by the 
image signal mto a plurality of areas (tiles). 

The DC level/color convCTsion section 1 1 sends the wavelet conversion section 12 
the image signal that has undergone the level shifting process, color space conversion and 
tiling process. 

The wavelet conversion section 12 performs wavelet conversion, tile by tile, using 
the supplied image signal. 

Specifically, the wavelet conversion section 12 performs low-pass filtering and 
high-pass filtering in both the vertical direction and horizontal dnection of the image. As a 
result, tihe image is broken down to a plurality of sub bands. In case where the breakdown 
level is 2, for example, the image is broken up into seven sub bands as shown in Fig. 3. 
Then, the wavelet conversion section 12 sends the wavelet coefficients (conversion 
coefficients) of the individual sub bands to the quantizing section 13. 

In Fig. 3, LL is a sub band obtained when low-pass filtering is performed in both 
the vertical direction and horizontal direction. HL is a sub band which is acquired v/hca 
high-pa.ss filtering is performed in the horizontal direction and low-pass filtering is 
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performed in the vertical direction. LH is a sub band which is acquired when low-pass 
filtering is perfonned in the horizontal direction and high-pass filtering is performed in the 
vertical direction. HH is a sub band obtained when high-pass filtering is performed in both 
the vertical direction and horizontal direction. Of the images of those sub bands, the image 
5 of the sub band LL has an image quality closest to the image quality of the original image. 

The quantizing section 13 quantizes the conversion coefficients supplied ftom the 
wavelet conversion section 12. Then, the quantizing section 13 sends the quantized 
conversion coefficients to the coefRcirat modeling section 14. 

The coefficient modeling section 14 performs the modeling process on the 
1 0 conversion coefficients supplied from the quantizing section 13. 

Specifically, as shown in Fig. 4, the coefficient modeling section 14 divides each 
supplied conversion coefficient to code blocks of a predeteraiined size first {step Sll). 

Subsequently, the coefficient modeling section 14 divides each conversion 
coefficient in each code block into bit planes (step SI 2). The least significant bit plane 
1 5 includes the LSB (Least Significant Bit) of each conversion coeflficioit and the most 

significant bit plane includes flie MSB (Most Significant Bit) of each conversion coefficient 

Then, the coefifidoit modeling section 14 classifies the individual conversion 
coefficients to three encoding passes for each bit plane while discriminating whether each 
conversion coefficient in each bit plane is significant or insignificant (step S13). 
20 A "significant coefficient" is a conversion coefficient in whose upp^ bit plane " 1 " 

has occurred (i.e., a coefficient whose value is discriminated as being not "0"). An 
"insignificant coefficient" is a conversion coefficient in whose upper bit plane "1" has not 
occurred (i.e., a coefficient whose value is or may be "0"). 

The three encoding passes are Significance propagation pass, Magnitude 
2 5 refinement pass and Cleanup pass. 

The Significance propagation pass includes insigmficant conversion coefficients 
around which there are significant coefficients. Tlie Magnitude refinement pass includes 
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significant conversion coeHicients. Hie Qeanup pass includes the remaining conversion 
coefficients that are not included in both the Significance propagation pass and Magnitude 
refin^entpass. 

Through the classification* each conv^ion coefficient is represented by symbols D 
of "O"or"r'. 

The coefficient modeling secdon 14 gen^ates contexts CX representing the statistic 
property of each conversion coefficient based on the significance/insignificance of 
conversion coefficient^: around that conversion coefficient (step S14). 

The coefficient modeling section 14 sends tiie symbols D and contexts CX, 
obtained in the modeling, to the arithmetic encoding section 15 for each oicoding pass (step 
S15). 

The arithmetic encoding section IS executes anthmetic encoding for each encoding 
pass using tiie symbols D and contexts CX supplied ftom the coefficimt modeling section 
14. Hie arithmetic encoding tiiat is executed by the arithmetic encoding section IS uses a 
binary encoding algorithm called MQ encoding. 

Specifically, as shown in Fig. 5A, the arithmetic encoding section IS first initializes 
parameters to be used in arithmetic encoding (step SlOl). 

Next, the arithmetic encoding section 15 fetches the symbols D and contexts CX 
supplied (step S102). 

Hien, the arithmetic mcoding section IS executes an encoding process using the 
fetched symbols D and contexts CX (step SI 03), 

The detailed contents of the encoding process that is executed in step S103 will be 
described later. 

Thereafter, the arithmetic encoding section IS determines whether coding in tiie 
encoding pass to be processed has been completed or not. Accordingly, the arithmetic 
encoding section IS discriminates whether the arithmetic oicoding process for the encoding 
pass to be processed is to be teraiinated or not (step S104). 



In a case where it is not discriminated that coding in the encoding pass to be 
processed has been completed (NO in step S104), the arithmetic encoding section 15 
returns to the process of the step S 1 02. 

Jn a case where it is discriminated that coding in the encoding pass to be processed 
has been completed (YES in step S104), the arithmetic encoding section 15 performs a 
flash process to flash out data obtained in the arithmetic ^coding (step SI 05) and 
tcmiinates the arithmetic encoding process for a single encoding pass. 

The arithmetic encoding section 15 performs the above-described processes for 
each encoding pass. 

The code order control section 16 goierates a bitstream by sorting data, acquired 
through the arithmetic encoding. 

Thoa, the code order control section 16 adds header information to the generated 
bitstream and stores the resultant bitstream in the data storage section 3. 

The bitstream stored in the data storage section 3 is decoded (expanded) by the 
decoding section 4 and is then supplied to the external output unit by tiie image output 
section 5. Alternatively, ttie bitstream is supplied to an external terminal or an external 
decoding unit by the code output section 6. 

A description will now be given of the encoding process that is carried out in step 
S103 by the arithmetic encoding section 15, 

As shown in Fig. 5B, the arithmetic encoding section 15 discriminates whetiier the 
value of the fetched symbol D is "0" or not (step S201). 

In a case where it is discriminated that flie symbol D is not "0", i.e., that the symbol 
D is "1" (NO in step S201), the arithmetic encoding section 15 executes a process 
"CODEl" based on the ISO/DBC 15444 Recommendation (step S202). 

In a case where it is discriminated that the symbol D is "0" (YES in step S201), on 
the other hand, die arithmetic encoding section 15 executes a process "CODEO" based on 
the ISO/IEC 15444 Recommendation (step S203). 



Fig. 6A is a flowchart illustrating the CODEl that is performed nonnally in the step 
S202, and Fig. 6B is a flowchart illustrating the CODED that is performed normally in the 
step S203. Fig. 7A is a flowchart illustrating the CODEl that is executed in the step S2Q2 
when the invention is adapted, and Fig. 7B is a flowchart illustrating the CODEO that is 
5 executed in the step S203 when the invention is adapted. 

First, the CODEl and CODEO that are carried out nonnally will be discussed. 

In the CODEl, as shown in Fig. 6A, the arithmetic encoding section IS 
discriminates whether the fetched symbol D is an MPS (More Probable Symbol) or LPS 
(Less Probable Symbol). Specifically, the arithmetic ^coding section 15 discriminates 
1 0 whether an MPS identifying flag MPS (CX) corresponding to the current context CX is "1" 
ornot(step S301). 

In a case where it is discriminated that the MPS(CX) is not "1 i.e., that the symbol 
D is an LPS (NO in step S301), the arithmetic encoding section 15 ^ecutes a process 
"CODELPS" based on the ISO/IEC 15444 Recommendation (step S302). 
15 In a case where it is discriminated that the MPS(CX) is " 1 i.e., that the symbol D 

is an MPS (YES in step S301), on the other hand, the arithmetic encoding section 15 
executes a process "CODEMPS" based on tiie ISO/IEC 15444 Recommendation (step 
S303). 

As apparent from the above, the CODELPS is carried out in a case where the 
2 0 MPS(CX) is not " 1 i.e., prediction has failed and the CODEMPS is carried out in a case 
where the MPS(CX) is "1", i.e., prediction has been met 

In the CODEO, as shown in Fig. 6B, the arithmetic encoding section 15 
discriminates whether the fetched symbol D is an MPS or LPS. Specifically, the arithmetic 
encoding section 15 discriminates whether an MPS identifying flag MPS (CX) 
2 5 corresponding to the current context CX is "0" or not (step S401). 

In a case where it is discriminated diat die MPS(CX) is not "0", i.e., that the symbol 
D is an LPS (NO in step S401), the aritiunetic encoding section 15 executes the CODELPS 



(step S402). 

In a case where it is discriminated that the MPS(CX) is "0", i.e., that the symbol D 
is an MPS (YES in step S401), on the other hand, ttxe arithmetic encoding section 15 
«ecutes die CODEMPS (step S403). 

As apparent from the above, the CODELPS is carried out in a case where die 
MPS(CX) is not "0", i.e., prediction has failed and die CODEMPS is carried out in a case 
where die MPS(CX) is "0", i.e., prediction has been met. 

In other words, in the normal process, die CODEMPS is always carried out when 
prediction is met and the CODELPS is always carried out when prediction has failed. 

In case where the invention is adapted, the CODEMPS is executed when a 
predetermined condition is satisfied as shown in Figs. 7A and 7B even when prediction has 
failed 

In ihc CODEl, as shown in Fig. 7A, the arithmetic encoding section 15 
discriminates whether the fetched symbol D is an MPS or LPS. Specifically, die arithmetic 
encoding section 15 discriminates whedier an MPS identifying flag MPS (CX) 
corresponding to the current contact CX is "1" ornot (step S501). 

In a case where it is discriminated that die MPS(CX) is "1 i.e., diat die symbol D 
is an MPS (YES in step S501), the arithmetic encoding section 15 executes the CODEMPS 
(step S502). 

In a case where it is discriminated diat die MPS(CX) is not "1 i.e., diat the symbol 
D is an LPS (NO in step S501), the arithmetic encoding section 15 compaies die probability 
that prediction will fail, i.e., the probability of occiurence, Qe, of an LPS with respect to the 
current context CX widi a predeterauned threshold value Th. Specifically, die aridimetic 
encoding section 15 discriminates whether or not the probability of occurrence Qe is greater 
than the threshold value Th (step S503). 

In the MQ encoding, the arithmetic encoding section 15 is provided with a 
probability prediction table where multiple probabilities of occurrence Qe are stored. The 



arithmetic encoding section IS selects a probability of occuirmce Qe corresponding to the 
current context CX from the given probability prediction table and uses it in comparison 
with the threshold value Hi. The threshold value Th is preset based on theoretical 
calculation, experiment and so forth in accordance with the required image quality and 
5 compressibility. For example, the threshold value Th is set in such a way that the threshold 
value Th is smaller than the maximum one of the probabilities of occuirence Qe stored in 
the probability prediction table and lies within the range over which the required image 
quality and compressibility can be realized even if the CODEMPS is performed when 
prediction has failed. For example, the direshold value Th is set to O.S. The i»x>bability of 

1 0 occurrence Qe being 0.5 means that the probability of occuirence of an MPS is equal to the 
probability of occurrence of an LPS, i.e., the probability of that prediction will be met is 
equal to ihe probability of that prediction will fail. 

In a case where it is diisciiminated in the step SS03 that the probability of 
occurrence Qe is greato: than the threshold value Th (YES in step S503), the arithmetic 

1 5 encoding section 1 5 changes the symbol D to "0" from " 1 " (step S504). Then, the 
arithmetic encoding section 15 executes the CODEMPS in step S502. 

In a case where it is not discriminated in the step S503 that the probability of 
occurrence Qe is greater than the threshold value Th (NO in step S503), the arithmetic 
encoding section 15 carries out the CODELPS (step S505). 

20 In the CODEO, as shown in Fig, 7B, the arithmetic encoding section 15 

discriminates whether the fetched symbol D is an MPS or LPS. Specifically, the arithmetic 
encoding section 15 discriminates whether an MPS identifying flag MPS (CX) 
corresponding to the current context CX is "0" or not (step S601). 

In a case where it is discriminated that the MPS(CX) is "0", i.e., that the symbol D 

25 is an MPS (YES in step S601), the arithmetic encoding section 15 executes the CODEMPS 
(step S602), 

In a case where it is discriminated that the MPS(CX) is not "0'*, 1.6., that the symbol 



IB 

D is an LPS (NO in step S601), the arithmetic encoding section 15 compares the probability 
that prediction wiU fail, i.e., the probability of occurrence, Qe, of an LPS with respect to the 
current context CX with a predetermined threshold value Th. Specifically, the aritfimetic 
encoding section 15 discriminates whether or not the probability of occurrence Qe is greater 
than the threshold value Th (step S603). 

In a case where it is discriminated in the step S603 that the probability of 
occurrence Qc is greater than the threshold value Th (YES in step S603), the arithmetic 
encoding section 15 changes die symbol D to "1 " from "0" (step S604). Then, the 
arithmetic encoding section 15 executes the CODEMPS in step S602. 

In a case where it is not discriminated in the step S603 that the probability of 
occurrence (Je is greater than the threshold value Hi (NO in step S603), the arithmetic 
encoding section 15 carries out the CODELPS (step S605). 

AWth the invention ad^ted, as ^parent from ttie above, in case where the 
probability of occurrence Qe of an LPS is greater than fte threshold value Th even when 
prediction has failed, i.e., in case where executing the CODEMPS does not affect the image 
quahty significantly, the CODEMPS is executed- Accordingly, the number of times 
renormalization is performed is less than the one in the normal case (Figs. 6A and 6B). 
This can result in a higher compressibility than is obtained in the normal case (Figs. 6A and 
6B). 

In case where the range of the threshold value Th that can ensure the required 
image quality and compressibility differs from one of the three encoding passes to another, 
different threshold values Th may be set for the Ihree encoding passes respectively. Then, 
the ariflmxetic encoding section 15 may execute the CODEl and CODED using the 
threshold values Th respectively set for the three encoding passes. 

The degree of degradation of the image quality that occurs by execution of the 
CODEMPS when the symbol D is an LPS is the greatest for the sub band LLand the 
smallest for the sub band HH. Therefore, the threshold value Th for the sub band LL may 
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be set larger than the threshold values Tb for the other sub bands, and the threshold value 
Th for the sub band HH may be set smaller than the threshold values Th for the other sub 
bands. Alternatively, the threshold value Th for the sub band LL may be set larger than the 
value that the probability of occurrence Qe can take and the CODELPS may always be 
executed for the sub band LL when the symbol D is an LPS. 

The CODELPS may always be caiiied for a predetermined number of bit planes 
firom the lowest one of the bit planes that are generated by the coefficient modeling section 
14, The nimiber of bit planes for which the CODELPS is always executed when the 
symbol D is an LPS is determined based on theoretical calculation, experiments and so 
forth in accordance with the required image quality and compressibility. 

In case where there is an encoding pass (degrading pass) for which the image 
quaUty is significantly degraded by the execution of the CODEMPS when the symbol D is 
an LPS, the arithmetic encoding section 15 may discriminate for each encoding pass 
whether or not comparison of the probability of occurrence Qe witti the ttireshold value Th 
should be carried out when the symbol D is an LPS. 

For example, when the Significance propagation pass and Magnitude refinement 
pass in the aforementiioned three encoding passes are degrading passes, execution of the 
CODEMPS may be inhibited for the Significance propagation pass and Magnitude 
refinement pass when the symbol D is an LPS. 

In this case, as shown in Figs. 8A and 8B, the arithmetic encoding section 15 may 
discrimmate, between step S501 and step S503 shown in Fig. 7 A and between step S601 
and step S603 shown in Fig. 7B, whether or not the encoding pass to be processed is a 
degrading pass (step S701 , S80I). In a case where it is discriminated that the target pass is 
a degrading pass (YES in step S701 , S801 ), the arithmetic encoding section 15 may execute 
the CODELPS (step S505, S60S). In a case where it is discriminated that Che target pass is 
not a degrading pass (NO in step S701, S801), the arithmetic encoding section 15 may 
discriminate whether the probability of occurrence is larger than die tiireshold value Th 
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(step S503, S603). 

The foregoing description of the embodiment has been given of an image 
encoding/decoding apparatus taken as an example. The invention can however be adapted 
to an application program or the like which is installed in a computer to perform 
encoding/decoding of image signals. 

The illustrated image encoding/decoding apparatus of the embodiment does not 
request a process different from a normal process to Ihe decoding unit (decoder) which 
decodes image data based on the JPEG2000 standard. In other words, the decoding unit 
(decoder) can decode image data, acquired through encoding (compression) performed by 
the above-described image encoding/decoding apparatus, in accordance with the ISO/IEC 
15444 Recommendation. 

The ^paratus of the preset invention can be realized by a general computer, 
wiAout the need for a dedicated apparatus. A program and data for controlling a computer 
to execute the above-described processes may be recorded on a medium (a floppy disk, 
CD-ROM, DVD or the like) and distributed, and the program may be installed into the 
computer and run on an OS (Operating System) to execute the above-described processes, 
thereby achieving the apparatus of the present invention. The above program and data may 
be stored in a disk device or the like included in the server device on the Internet, and 
embedded in a carrier wave. The program and data embedded in the carri^ wave may be 
downloaded into the computer so as to realize the apparatus of the present invention. 

Various embodiments and changes may be made thereonto without departing from 
the broad spirit and scope of the invention. The above-described embodiment is intended to 
illustrate the presrait invention, not to Ihmt the scope of the present invention. The scope of 
the present invention is shown by the attached claims rather than the embodiment Various 
modifications made within the meaning of an equivalent of the claims of the invaition and 
within the claims are to be regarded to be in the scope of the preset invention. 

TTiis application is based on Japanese Patent Application No. 2002-206217 filed on 
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July 15, 2002, and including specification, claims, drawings and summary. The di.^closure 
of the above Japanese Patent Application is incorporated herein by reference in its ratirety. 



